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ABSTRACT 


( 


The  Canadian  SARSAT  users  Initiated  field  trials  to  test  the 
performance  of  the  SARSAT  ground  station  under  the  conditions  of  fringe 
coverage.  '-The  data  generated  as  a  result  of  these  trials  was  analyzed  and 
results  are  presented.  It  Is  concluded  that  SARSAT  can  function  adequately 
under  such  conditions  but  that  this  performance  can  only  be  recognized  by 
users,  If  they  have  better  visibility  Into  available  signal  processing 
quality  Indicators. 


RESUME 


Les  usagers  canadlens  du  systeme  SARSAT  ont  mene  des  essals 
operatlonnels  afin  d'evaluer  la  performance  d'une  station  terrestre  SARSAT 
dans  des  conditions  de  reception  limitrophe.  Les  donnees  recuelllles  a  la 
suite  de  ces  essals  ont  fait  I'bjet  d'une  analyse  et  les  resultats  ont 
revele  que  le  systeme  SARSAT  peut  fonctlonner  adequatement  dans  des 
conditions  de  reception  limitrophe.  II  Importe  de  signaler  toutefols  que 
seuls  les  usagers  peuvent  reconnaftre  cette  performance  s' 11s  sont 
sensIblHses  davantage  a  la  disponiblllte  des  Indicateurs  de  quallte  en 
matlere  de  traltement  des  signaux. 


(Ill) 


1.0  INTRODUCTION 


The  Canadian  COSPAS-SARSAT  users,  and  In  particular  the 
Officer-1 n-Charge  of  the  Canadian  Mission  Control  Centre  (CMCC),  were 
concerned  about  the  performance  of  COSPAS-SARSAT  under  fringe  coverage 
conditions.  The  particular  condition  of  concern  was  the  situation  when  the 
Time  of  Closest  Approach  (TCA)  was  either  outside  or  near  the  edge  of  the 
ground  tracking  station's  viewing  window.  In  order  to  test  the  system 
under  these  conditions,  the  CMCC  organized  test  activations  of  standard, 
commercially  available  Emergency  Locator  Beacons  (ELTs)  transmitting  at 
121.5  MHz  through  the  Rescue  Coordination  Centre  (RCC)  Edmonton  at  a 
position  on  the  periphery  of  the  Ottawa  SARSAT  Local  User  Terminal  (LUT) 
coverage.  Tests  were  carried  out  at  Resolute  Bay  (74.72N,  094. 95W)  on 
27-28  May  84.  - 

■  III 

Evaluation  personnel  from  the  SARSAT  Project  Office  at  the 
Defence  .Research  Establishment  Ottawa,  In  analyzing  the  results  of  these 
tests,  used  the  test  data  to  Illustrate  developmental  techniques  which  were 
being  studied  for  the  purposes  of  providing  the  Canadian  COSPAS-SARSAT 
users  with  a  more  useful  data  package.  It  has  been  argued  for  some  time 
that  Canadian  users  are  being  provided  too  much  extraneous  data  and  at  the 
same  time  they  are  being  denied  vital  characterization  data. 


2.0  TEST/EWLUATION  TECHNIQUE 


Simply  stated,  the  test  conditions  consisted  of  activating  a 
commercially  available  ELT  and  leaving  It  on  for  the  period  In  question. 
The  test  site  was  In  northern  extremes  of  Canada,  a  region  of  low  ELT 
activity.  Hence,  the  chance  of  Interference  from  other  ELT  activity  was 
considered  low.  Furthermore,  Resolute  Bay  Is  at  the  extreme  of  Ottawa  LUT 
coverage  and  therefore  the  test  would  generate  evaluation  data  reflecting 
LUT  performance  under  fringe  conditions. 

During  the  Demonstration  and  Evaluation  phase  of  the  SARSAT 
Project,  all  LUT  data  were  routinely  stored  on  magnetic  tape  and 
transferred  to  the  SARSAT  Evaluation  Facility  (SEF)  where  they  were  loaded 
onto  a  data  base.  These  data  were  then  available  In  a  structured  form  for 
evaluation  purposes. 


As  the  evaluation  of  the  data  proceeded.  It  became  evident  that 
the  Resolute  Bay  tests  could  provide  a  convenient  mechanism  to  Illustrate 
the  potential  that  exists  In  LUT  data  to  enhance  user  visibility  Into  what 
might  be  occurring.  This  In  turn  would  allow  the  Canadian  user  community 
to  make  better  operational  use  of  the  COSPAS-SARSAT  data. 

This  Initial  program  of  stu(1y  led  to  a  more  Indepth  study  which 
was  subsequently  carried  out  and  documented  elsewhere,  see  Ref.  1. 


3.0  SUMMARY  OF  RESULTS 


The  summary  results  for  the  Resolute  Bay  tests  are  considered  In 
terms  of  the  data  generated  by  the  Ottawa  LUT,  the  data  passed  to  the  CMCC, 
and  the  data  the  CMCC  should  have  received  (cluster  analysis). 


3.1  THE  LUT  DATA 

Using  the  program  LOCAT,  see  Ref.  2,  the  SEF  data  base  was 
queried  for  all  LUT  generated  ELT  detections  for  the  period  27-28  Maty  1984 
within  a  radius  of  250  km  around  the  position  74.72N,  94.95VI.  The  output 
from  this  query  Is  Illustrated  In  Tables  1(a)  and  Kb).  Note  that  the 
Image  data  Is  not  listed  because  the  CMCC  data  was  not  Integrated  Into  the 
data  base. 

Table  1(a)  Identifies  the  pass,  the  estimated  location  of  the 
ELT,  the  associated  error  and  flag  Information  (MCC  Reference  Mo.,  LUT 
event  number,  flag  concerning  whether  CMCC  was  sent  a  message,  and 
frequency  band).  Table  Kb)  provides  a  subset  of  available  LUT  parameters 
which  should  be  used  to  characterize  the  estimate. 

Considering  the  total  LUT  data  set,  the  following  comments  are 
made.  The  LUT  provided  26  discrete  detections  on  eight  passes  during  the 
two  day  period.  Three  passes  Involved  the  SARSAT  satellite  and  five  passes 
used  the  COSPAS  satellites.  The  location  error  ranged  from  a  minimum  of 
4.46  km  to  a  maximum  of  232.45  km  with  a  mean  error  of  estimation  being 

49.1  km. 

Referring  to  Table  Kb)  and  the  PROB  column.  It  should  be  noted 
that  the  LUT  was  totally  unable  to  resolve  ambiguity.  On  three  occasions 
It  chose  the  Image  location  as  the  primary  position,  on  five  occasions  It 
made  the  right  choice,  and  on  the  remaining  eighteen  It  gave  equal  weight 
to  both  locations. 
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The  LUT  has  a  sideband  filter  which  reduces  extraneous  detections 
going  to  the  CMCC.  This  filter  Is  based  on  a  distance  criteria  and  Is  only 
available  for  the  COSPAS  satellites. 

In  the  case  of  the  Resolute  Bay  tests,  14  detections  passed  the 
LUT  filter.  The  CMCC  visibility  Into  results  Indicated  a  location  error 
ranging  from  a  minimum  of  4.4  km  to  a  maximum  of  232.5  km  with  a  mean  error 
of  estimation  being  74.9  km.  This  Increase  In  error  Is  due  to  good 
sideband  estimates  for  COSPAS  satellites  being  held  at  the  LUT  while  the 
CMCC  received  bad  sideband  estimates  for  the  SARSAT  satellite. 

Mean  error  estimates  by  satellite  at  each  facility,  I.e.  LUT  and 
CMCC,  are  summarized  In  Table  2. 


TABLE  2 

Mean  Error  of  Location  (Km) 
Satellite 


COSPAS 

SARSAT 

BOTH 

34.5 

97.8 

49.1 

57.7 

97.8 

74.9 

A  number  of  Items  are  apparent  from  the  data  In  Table  2. 
Firstly,  It  Is  evident  that  COSPAS  Is  performing  better  than  SARSAT.  This 
however  Is  a  known  fact.  Secondly,  while  It  Is  necessary  to  have  sideband 
filtering  available,  the  CMCC  without  additional  Information  Is  actually 
losing  location  resolution. 

This  now  leads  Into  a  discussion  concerning  what  data  the  CMCC 
should  receive. 


3.3  CLUSTER  DATA 

Table  3(a)  and  3{b)  contain  the  data  which  the  CMCC  should  have 
received.  It  consists  of  nine  detections.  Table  3(a)  would  constitute  the 
operational  data  while  Table  3(b)  contains  the  parameter  Information.  It 
Is  suggested  that  Table  3(b)  data  while  of  necessity  be  available  at  the 
CMCC,  they  are  only  required  on  an  exception  basis. 


TABLE  3(a) 

Cluster  Data  -  Primary 
Resolute  Bay,  27-28  May  84 


The  data  are  the  result  of  merging  sidebands  within  the  pass 
according  to  a  distance  criteria  (250  km)  and  an  ELT  bias  check  (3000  Hz). 
In  addition,  a  quality  factor  which  Is  an  Indicator  of  density  of  the 
Doppler  curve  correcting  for  the  amount  of  the  curve  seen  by  the  LUT  Is 
provided.  Finally,  three  types  of  flag  Information  are  provided.  The 
first  gives  an  Indication  of  the  goodness  of  the  geometry >  1*e.  the  Cross 
Track  Angle  (CTA)  at  TCA,  and  the  TCA  flags,  the  second  type  describes  the 
structure  of  the  Doppler  curve,  I.e.  Standard  Deviation  (STD)  and  Trend, 
and  the  third  resolves  dual  frequency  beacons  (SARSAT  only). 


The  flag  definitions  used  were  as  follows: 


CTA  Flag: 


TCA  Flag: 


STD  Flag: 


TREND  Flag: 


FREQ  Flag; 


0  CTA  <2* 

1  2‘<CTA<18'’ 

2  CTA  > 18* 

0  unless 

TCA  < (AOS  -  60  seconds ) 
or  TCA  > (LOS  +  60  seconds) 

0  0  <  STD  <  9 

1  9  <  STD  < 19 

2  19  <  STD  <  28 

3  STD  >28 

0  0  <  TREND  <  5 

1  5  <  TREND  <  10 

3  TREND  >10 

121.5  MHz  8 

243  MHz  16 

121.5/243  MHz  24 


The  data  given  In  Table  3  are  summarized  In  Table  4  to  Illustrate 
how  operationally,  merged  data  could  be  actioned. 


'y/'V  V: 


TABLE  4 


RESOLUTE  BAY 
MERGE  SUMMARY 


PASS 

SAT  PASS 

ERROR 

(KM) 

CLUSTER 

SIZE 

QUALITY 

FI 

.AGS 

CATEGORY 

CTA 

TCA 

STD 

TREND 

1 

Cl 

9541 

26.5 

3 

0.60 

1 

0 

0 

0 

GOOD 

2 

SI 

6060 

150.4 

2 

0.77 

0 

1 

0 

0 

POOR 

3 

Cl 

9542 

14.8 

5 

0.82 

1 

0 

0 

0 

EXCELLENT 

4 

SI 

6061 

12.1 

2 

0.68 

1 

0 

0 

1 

GOOD 

5 

Cl 

5905 

5.9 

5 

0.81 

1 

0 

0 

0 

EXCELLENT 

6 

Cl 

9546 

20.3 

3 

0.77 

1 

1 

0 

0 

GOOD 

Cl 

9546 

232.5 

1 

0.67 

1 

1 

1 

2 

BAD 

7 

Cl 

9548 

4.5 

3 

0.88 

1 

1 

0 

0 

EXCELLENT 

8 

SI 

6068 

215.4 

2 

0.49 

1 

1 

2 

2 

BAD 

y 

5  3.4  DATA  CATEGORIZATION 

j  Subsequent  work  at  OREO  developed  additional  approaches  to 

/  analytically  categorize  LUT  generated  alerts  based  upon  a  parameter  set  as 

\  illustrated  in  Table  3,  See  Ref.  1.  For  the  purpose  of  analyzing  the 

f  Resolute  Bay  tests,  an  intuitative  categorization  was  made  and  is  given  in 

.  Table  4.  Given  that  the  CMCC  has  the  data  from  Table  3  available,  it  could 

I  categorize  the  LUT  alerts  along  the  approaches  now  described. 

J  On  Pass  1,  the  cluster  size  was  3,  indicative  of  a  carrier  plus  2 

sidebands,  hence  a  reasonable  functioning  ELT.  The  quality  indicator  was 
acceptable  but  not  spectacular.  Geometry  and  data  quality  flags  were  all 
okey.  Hence,  not  a  spectacular  detection,  but  a  solid  good  detection. 

I  Pass  2  suffered  a  number  of  shortcomings.  Firstly,  the  cluster 

size  is  small.  Clusters  of  size  1  or  2  appear  to  be  "orphan  activities". 
Secondly,  geometry  is  bad.  However,  for  what  curve  is  available,  the  data 
is  solid.  Hence,  it  is  not  a  bad  detection,  but  it  is  obviously  a  poor 
one.  - 

j  Pass  3  seems  to  have  everything  going  for  it.  It  is  simply 

i;  classified  excellent. 

^  Pass  4  has  a  few  problems.  The  cluster  size  is  down,  and  there 

is  some  question  about  data  quality,  i.e.  the  Trend  flag  is  on  and  the 
j  Quality  factor  is  low.  However,  geometry  is  good.  On  this  subjective 

j  basis  it  is  classified  good. 
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Pass  5  like  pass  3  requires  no  discussion.  It  Is  judged 

excellent. 

Pass  6  provided  two  estimates.  The  second  estimate  Is  an  obvious 
sideband.  One  geometry  and  two  data  quality  flags  are  Indicating  poor 
results.  Furthermore  the  single  element  cluster  suggests  a  sideband  that 
missed  the  cluster  filter.  It  Is  judged  bad  data.  The  first  estimate  In 
Pass  6  Is  obviously  the  primary  location.  However,  the  TCA  flag  Is  on  and 
therefore  the  data  Is  categorized  as  good. 

Pass  7  Is  a  problem  to  classify.  Cluster  size  Is  reasonable  (a 
cluster  size  of  2  seems  to  be  a  threshold),  the  TCA  flag  Is  on  but  quality 
Is  very  high.  The  classification  Is  somewhere  between  good  and  excellent, 
and  excellent  was  arlbitarlly  chosen. 

Pass  8  requires  no  discussion.  It  Is  obviously  a  bad  estimate. 


4.0  DISCUSSION 

It  Is  apparent  from  the  foregoing  analysis  that  the  Ottawa  LUT, 
even  under  conditions  of  fringe  coverage,  can  produce  good  results.  The 
problem  Is  that  the  operational  personnel  at  the  CMCC  are  not  able  to 
distinguish  good  data  from  bad  data  because  they  do  not  have  sufficient 
visibility  Into  the  total  LUT  parameter  set. 

Volume  Is  the  biggest  problem  faced  by  the  Canadian  COSPAS-SARSAT 
user.  While  the  Resolute  Bay  tests  provide  a  very  restricted  sample  from 
which  to  extrapolate  cluster  merging  effects  on  data  volume,  the  following 
comments  are  made.  The  LUT  started  out  with  26  detections,  the  sideband 
filter  reduced  the  data  to  9  detections.  Furthermore,  with  ancllllary  data 
provided  by  the  cluster  analysis,  3  poor  or  bad  alerts  were  easily 
recognized.  Therefore  of  the  26  LUT  detections,  20  can  be  screened  out  as 
either  not  being  operationally  useful  data  (the  17  detections  filtered  out 
by  the  cluster  analysis)  or  data  of  such  dubious  quality  that.  In 
Isolation,  Immediate  operational  action  should  not  be  taken  (the  3  latter 
detections).  This  filtering  could  Imply  a  77%  reduction  In  data  volume 
from  LUT  to  the  actioning  CMCC  operator  with  no  loss  In  operational 
effectiveness.  In  fact,  with  Increased  visibility  Into  data  quality, 
operational  effectiveness  Is  enhanced. 

Table  5  expands  on  Table  2  to  Illustrate  enhanced  confidence  In 
location  estimation  following  a  cluster  analysis. 
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TABLE  5 

MEAN  ERROR  OF  LOCATION  (Km) 
Satel 1 1 te 


COSPAS 

SARSAT 

ALL 

LUT 

34.5 

97.8 

49.1 

CMCC 

.  Current  Filter 
.  Cluster  Filter 

57.7 

97.8 

74.9 

Excellent/Good  Data 

14.4 

12.1 

14.0 

Poor/Bad  Data 

182.9 

232.5  . 

199.4 

The  Implication  In  quoting  enhanced  confidence,  as  Illustrated  in 
Table  5,  Is  that  CMCC  operators  must  have  facilities  to  recognize  good  and  • 
bad  data.  The  analysis  of  the  Resolute  Bay  tests  demonstrate  that 
facilities  do  exist  within  the  current  LUT  data  set. 

The  discussion  so  far  has  concentrated  on  having  a  historical 
perspective  on  a  known  beacon  activation  during  a  know  time  period.  This 
Is  not  the  normal  operational  environment  at  the  CMCC.  In  order  to 
Illustrate  clustering  capabilities  on  a  pass-by-pass  basis,  one  particular 
pass.  Cl  09542,  27  May  84  Is  considered. 

Table  6  Illustrates  a  minimum  data  set  that  could  be  sent  by  the 
LUT  to  the  CMCC  for  operational  processing.  Data  packing  In  the  example 
given  could  consist  of  twelve  records,  a  header  record  and  eleven  data 
records. 


As  a  result  of  the  cluster  analysis  four  data  displays  are 
generated.  These  Include: 

Operational  Data  Set  (Primary  Data) 

Operational  Data  Set  (Secondary  Data)  -  Parameter 
Cluster  Data  Set  (Primary  Data) 

Cluster  Data  Set  (Secondary  Data)  -  Parameter 


TABLE  6 


Sample  Transfer  Data  Set 
LUT  to  CMCC 


SAT  Pass:  Cl  09542 

AOS: 

22.9186 

Time: 

840527 

LOS: 

23.1669 

Primary 

Secondary 

Seq.  No. 

LUT  Seq. 

Freq. 

ELTLAT 

ELTLONG 

ELTLAT  ELTLONG 

1) 

1 

8 

44.7677 

-118.5648 

42.5169  -  89.2099 

2) 

2 

8 

73.0106 

-  80.9718 

74.7542  -  94.4638 

3) 

3 

8 

74.7822 

-  94.5652 

73.0116  -  80.8571 

4) 

4 

8 

73.0061 

-  80.9967 

74.7461  -  94.4667 

5) 

5 

8 

73.0305 

-  80.9567 

74.7706  -  94.4163 

6) 

6 

8 

36.0704 

-  94.3136 

37.3911  -113.5813 

7) 

7 

8 

36.0615 

-  95.3960 

37.3662  -113.4967 

8) 

8 

8 

25.7772 

-100.8325 

26.3154  -109.0557 

9) 

9 

8 

73.3308 

-  82.1293 

74.6940  -  92.6233 

10) 

10 

8 

44.6901 

-118.1331 

42.5145  -  89.5930 

11) 

11 

8 

42.4615 

-125;6715 

39.6361  -  83.2387 

Parameters 

-  Primary  Location 

CTA 

POINTS 

SDEV 

TREND  NMWLS  TCA  BIAS 

1) 

11.0759 

314 

10.6123 

2.2657 

2  23.0099  14589 

2) 

-1.9305 

219 

5.6638 

1.1352 

2  23.1589  16065 

3) 

2.2481 

207 

5.8571 

2.0905 

1  23.1592  14782 

4) 

-1.9266 

172 

7.3423 

1.9567 

2  23.1589  16686 

5) 

-1.9240 

247 

4.0283 

1.4274 

1  22.9734  15437 

6) 

-7.1370 

108 

17.1609 

8.9501 

2  22.9734  8252 

7) 

-7.0730 

100 

16.3438 

8.7486 

3  22.9733  7626 

8) 

-3.9139 

117 

24.7359 

10.7925 

-5  22.9196  12834 

9) 

-1.4769 

81 

17.0974 

3.7443 

3  23.1595  13525 

10) 

10.7741 

96 

20.7957 

3.1007 

4  23.0094  14208 

11) 

16.4584 

136 

15.2269 

5.7642 

3  23.0015  11845 

Parameters 

-  Secondary 

Location 

1) 

-10.2371 

318 

11.9351 

5.6294 

2  23.0105  14568 

2) 

2.2140 

219 

5.7240 

0.8037 

2  23.1591  16055 

3) 

-1.9590 

207 

5.9432 

2.3200 

1  23.1590  14793 

4) 

2.2122 

172 

7.4350 

1.5905 

2  23.1591  16676 

5) 

2.2071 

247 

4.0835 

1.5691 

1  23.1592  15427 

6) 

7.5750 

107 

17.6056 

9.8031 

3  22.9732  8262 

7) 

7.5077 

100 

16.7639 

9.1539 

3  22.9731  7636 

8) 

3.5019 

118 

25.6544 

8.6011 

3  22.9195  12862 

9) 

1.7326 

81 

17.1110 

3.8180 

3  23.1596  13517 

10) 

-9.9660 

96 

21.6035 

6.1796 

3  23.0101  14187 

11) 

-15.4231 

135 

16.6356 

6.4050 

2  23.0038  11781 

These  data  are  Illustrated  In  Table  7(a)-(d).  Note  that  In  the 
secondary  data  set,  a  number  of  LUT  parameters  not  given  In  Table  6,  are 
provided.  The  utility  of  these  parameters,  I.e.  Major,  Minor  and  Drift 
are  still  being  Investigated.  It  should  also  be  noted  that  Table  7  data 
are  not  considered  as  operational  displays.  However,  they  do  Include  all 
the  data  required  for  CMCC  operator  action. 

Referring  now  to  Table  7(a),  the  following  operator  actions  are 
envisaged.  Clusters  3,  4  and  5  require  no  Immediate  action.  In  the 
absence  of  external  (or  previous  pass  data),  the  Information  provided  Is 
too  ambiguous  to  do  anything  with.  Data  quality  Is  low,  and  cluster  sizes 
are  small.  It  Is  even  suggested  that  such  data  be  surpressed  from  the  CMCC 
operator  as  "orphan  alerts"  until  such  time  as  additional  pass  data  Is 
correlated  to  It.  Clusters  1  and  2  requires  attention.  Cluster  1  Is  good 
data  although  the  cluster  size  Is  small.  However  this  negative  factor  Is 
counter-balanced  by  the  high  quality  of  the  data  and  the  apparent  Image 
resolute  capability,  ampllHed  by  tiie  PROB  factor  calculated  using  Trend. 
Cluster  2  requires  no  discussion.  It  Is  the  beacon  In  Resolute  Bay. 

Tables  7(c)  and  (d)  are  the  detailed  cluster  data  which  provide 
the  additional  Information  on  the  structure  of  the  cluster.  These  data  are 
only  required  on  a  exception  basis. 


5.0  SUMMARY  COMMENTS 


The  CMCC  tests  at  Resolute  Bay  have  been  analyzed  and  the  results 
presented.  It  has  been  demonstrated  that  the  LUT  can  operate  very  well 
under  the  conditions  of  fringe  coverage  given  that  one  has  sufficient 
visibility  Into  LUT  available  parameters  to  Interpret  the  data. 

Furthermore,  the  potential  capability  of  CMCC  operators  to 
quickly  and  effectively  action  COSPAS-SARSAT  data,  assuming  they  are  given 
the  right  data  set,  has  been  Illustrated. 

Statistical  studies  were  Initiated  to  develop  supporting  evidence 
for  the  methodologies  outline  (see  Ref.  1).  It  was  Important  to  establish 
cluster  analysis  threshold  parameters,  e.g.  distance  and  bias  criteria. 
The  utility  of  Trend  as  a  ambiguity  resolver  versus  Standard  Deviation  has 
to  be  demonstrated.  The  new  quality  factor,  while  looking  very  promising, 
must  be  validated.  The  size  of  the  cluster  seems  to  be  a  strong  Indicator 
of  how  CMCC  operators  should  respond  to  COSPAS-SARSAT  data.  Finally,  the 
specific  data  required  at  the  CMCC  from  the  LUT  has  to  be  specified. 
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Once  the  above  items  are  better  quantified  then  the  merge  In 
terms  of  the  pass-to-pass  clustering  of  data  can  be  addressed.  However,  It 
Is  readily  apparent  that  this  Is  just  a  cluster  analysis  on  a  different 
level,  I.e.  the  same  methodology  can  be  applied.  The  only  difference  now 
Is  that  a  Kalman  Filter  type  approach  should  be  used  to  derive  better 
location  estimates  once  ambiguity  has  been  resolved. 
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